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(54) System and method for lossless Image compression 



(57) Viossi ess ima ge^conpression encoder/deco- 
der system hiavfhg a context determination circutt and a 
code tat>le generator. The image compressor uses tfie 
context of a pixel to be encoded to predict the value of 
the pixel and determines a prediction error. TTie image 
compressor contains a context quantizer that quantizes 
the context of pixels. The image conrpressor counts the 
error values for each quantized context and uses these 
counts to generate context-specific coding tat)ies for 
each quantized context. As it encodes a particular pixel, 
the encoder looks up the prediction error in the context- 
specific coding table for the context of the pixel and 
encodes that value. To decompress an image, the 
decorrpressor determines and quantizes the context of 



each pixel being decoded. The deconrpressor uses the 
same pixels as the compressor to determine the con- 
text. The decompressor retrieves from the context-spe- 
cific coding tat)le the error value conresponding to the 
coded pixel. The deconrpressor uses a predictor to pre- 
dict the value of the pixel based on the context and adds 
the error value to determine the actual value of the pixel. 
In one embodiment the image compressor uses an 
alphabet extension, enrt>edded in its context nxxlel. in 
specific low gradient contexts to reduce the redundancy 
of the encoding. 

Other systems and methods are disclosed. 
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E)escrlption 

TECHNICAL FIELD OF THE INVENTION 

5 The invention relates generally to image compression, and, more particularly, to low complexity lossless and near- 
lossless compression having context-specific Huffman codes. 

BACKGROUND ART 

10 The use of compression algorithms for efficient data storage and communication has become a key component in 
most digital imaging systems. In many applications a reduction in the amount of resources required to store or transmit 
data is crucial, so that compression can be viewed as an enat>ling technology. Image compression algorithms are 
txoadly classified into lossy (inreversible) schemes, for which the original pixel intensities cannot be perfectly recovered 
from the encoded bit stream, and lossless (reversible) schemes, for which the cocfing algorithms yield decompressed 

75 images identical to the original digitized images. The latter, in general, are required in applications where the pictures 
are sut)jected to further processing, e.g. for the purpose of extraction of specific information. Most lossy compression 
techniques are designed for the human visual system and may destroy some of the information required during 
processing. Thus, Images from digital radiology in medicine or from satellftes in space are usually compressed by 
reversible methods. Lossless compression Is generally the choice also for Images obtained at great cost, for which It 

20 may be unwise to discard any Infbrnr^on than later may be found to be necessary, or In applications where the desired 
quality of the rendered Image Is unknown at the time of acquisition, as may be the case in digital photography. In addi- 
tion, lossless may t>e preferred over lossy in applications where intensive editing or repeated corrpression/decompres- 
slon are required: the accumulation of error due to a lossy Iteration may become unacceptak>le. 

Gray-scale images are considered as two-dimensbnal arrays of intensity values, digitized to some number of bits. 

25 In nrK>st applications 8 bits are used, although 12 bits is customary In digital radiology. Color images, in tum, are usually 
represented In some color space (e.g., RGB, YUV, LAB), in which each component Is a gray-scale image. Thus, tiie 
tools employed in the compression of color images are derived from those developed for gray-scale images arxJ our dis- 
cussions will generally focus on the latter. It should k>e noted tiiough that the combination of these tools in the case of 
color should take into account the possible correlatbn between color planes (e.g., In an RGB representation). Lossless 

30 image compression techniques often consist of two distinct and Independent conponents: modeling and coding. The 
nrKxJeling part can be formulated as an inductive infererx;e problem, in which an image is observed pixel by pixel in 
some pre-defined order (e.g., raster-scan). At ^ch time instant /. and after having scanned past data 
x' = XyXp* • *x^. one wishes to make Inferences on the next pixel value x^^ by assigning a conditional prot)abilfty dis- 
tribution to it. (Notice ttiat pixel values are irxJexed with only one subscript, despite corresponding to a two-dimensional 

35 array. This sut>script derx3tes the "time" index in the pre^Jef Ined order.) In a sequential formulation, this distritxition p( 
* I y ) is learned from the past, and the goal In the long run is to maxirrdze the probability assigned to the entire 
sequence 

40 p(x''^=np(^/+ii^') (1) 

/=1 



where denotes the empty string. In the coding part of the scheme, this prot)ability assignment could be used sequen- 
45 tiaily by an arithmetic coder to obtain a total code length of 

f- log P{)P )1 bits (hereafter, k)garrthms are taken to the base 2). Arithmetic coding is desaibed in J. Rissanen and G.G. 

Langdon, Jr., "Universal modeling and coding." IEEE Trans. Inform. Theory, vol. lT-27, pp. 12-23, Jan. 1981. Since the 

conditional probability used to encode x/^f depends only on x'. it is available to the decoder as It decodes the past string 

sequentially. Alternatively, In a two-pass scheme the conditional distribution can be learned from the whole image in a 
50 first pass and and some description of it must be sent to the decoder as header information. In this case, the total code 

lengtii includes the length of the header. Yet, Mh tiie second encoding pass and the (single-pass) decoding are subject 

to the same sequential fomnulation. 

In state-of-the^ lossless image compression schemes, the probability assignment is generally broken into the folbw- 
ing corrponents: 

55 

a. A prediction step, in which a deternnirdstic value x j^^ ls guessed for the next pixel x^^ based on a sut>string 
Xf^Xf2 * * - x/i^ of the availat)le past sequence V, where v denotes the order of the predictor. 

b. The determination of a context on which Xj^^ occurs. Again, this context is a function of a past subsequence 
^ti^i2' • • for some integer m. 
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c. A probabilistic model for the prediction residual (or error signaQ e^^ = x^^ ^ > conditioned on the context of 

Figure 1 is a block diagram of a typical lossless image compression scheme. The shaded areas 101 and 101 ' rep- 

5 resent the scanned past sequence V, on which prediction and context modeling are based, while the black dots 103 
and 103' represent the pixel kx^ation currently encoded. An image 105 is input to a nxxJeler 107. Inside the modeler 
107. the image is input to a predictor 109. Based on the sequence 101 that precedes the pixel 103 a predicted value for 
the pixel 103 Is guessed, Xj^<|. ITiis predicted value is subtracted from the actual value to obtain the error value 
{e^^ ~ x^, -x^^ ). TTie errors are then modeled in an error modeler 109. The prol>ability distribution of the error val- 

10 ues and the en^or values for individual pixels are fed to a coder 1 1 1 to produce an output compressed brtstream 1 1 3. 
The best available published compression ratios correspond to the scheme discussed in M.J. Weinberger, J. Ris- 
sanen, and R. Arps. "Applications of universal context modeling to lossless compression of gray-scale images," Sid>- 
mrtled for puWicatbn in /EEE Trans. Image Processing, which is inspired on the ideas of universal rrrodeiing, as 
reported in the comparative tables of results in Weinberger et al. In that method, the context for x^^^ is built out of 

IS dynamically varying quantized versbns of tiie differences x^ - x//. where x^ and x// are the values of two adjacent pixels 
within a fixed causa! tempiate (with respect to the scanned direction) which is used as tiie maximum search space for 
the context within The degree of quantization is determined dynamrcally with a complex calculation based on an intri- 
cate database of symbol occurrence counts. The variable sizes of the conditioning contexts are optimized based on the 
concept of stochastw complexity in order to prevent "oveifitting'the rrxxlel. In principle, larger contexts better capture 

20 the inherent ^structure " of the data, as they imply more skewed distributbns for the predknion residuals, which results 
in a better fit. 

However, choosing a model whose complexity is unnecessarily large (i.e., a model for which the same fit can be 
achieved with smaller contexts and. hence, with fewer parameters) negatively affects performance. These redundant 
parameters imply a "hiodel cost, " which in a sequential scheme can be interpreted as capturing the penalties of 

25 "context dilution ' occurring when count statistics mist be spread over too many contexts, thus affecting the accuracy 
of the conresponding estimates. In non-sequential (two-pass) schemes the nxxJel cost represents tfie code length 
required to encode tiie nxxJel parameters estimated in the first pass, which must t>e transmitted to the decoder. The 
prediction step in Weint>erger et €il. is accomplished with an optimized, context-dependent linear predictor, and the 
modeled prediction reskiuals are arithmetic erxxxled. The resulting code length is provat)ly asymptotically optimal in a 

30 certain t>road class of processes used to model the data. 

Both the nxxieling and coding part of the scheme of Weint}erger et al. are of high complexity, due to the complex 
underlying data structure used for prediction and context modeling, arxi the required arithmetic coder. Some alterna- 
tives exist whk;h use a fixed predk;tor and a non-optimized context model for the prediction reskiuals. with only moder- 
ate deterioration in tiie coirpression ratios obtained for some types of images (especially natural larxlscapes and 

35 portraits; the deterioration is more significant for medical and sat^lite images). One such technique is the version of the 
Sunset algorithm which forms the basis for the JPEG compression standard. This technk]ue is described in U.S. Pat. 
No. 4,749,983 to Langdon, entitied "^Compression of Multilevel Signals." 

However, the model used in these algorithms still requires arithmetic coding of prediction residuals, an operation 
that is considered too complex in many applicatbns, especially in software applications and in the very frequent case 

40 in which decoding speed is crucial. Other alternatives have been designed with simpficity in mind and propose minor 
variations of traditional DPCM techniques (a discussion of the DPCM technk^ue may be found in A. Netravali and J. O. 
Limb. "Picture coding: A review," Proc. IEEE. vol. 68, pp. 36&-406, 1980). which include Huffn^ coding of predkrtion 
residuals obtained with some fixed predictor. Thus, these techniques are fundamentally limited in their compression 
performance by the first order entropy of the prediction residuals. Their ability to 'decorrelate" the data is reduced to 

45 the prediction step, which in general cannot achieve total decorrelatbn. 

Ideally, the prediction of the value of the current pixel x^^^ based on its sunrounding pixels that have already been 
processed shoukj be done by adaptively learning a nrxxjel conditioned on the kx^al edge direction, as discussed in 
Weinberger et al. However, such adaptive learning is ^ceedingty complex. 

Nevertheless, a low-complexity edge detecta is desirable in order to approach the best possible predictors. 

50 The seven fixed linear predictors proposed for the lossless JPEG scheme (as described in ISO/IEC 10918-1 rru 
T.81. Digital compressbn and coding of continuous tone still images - Requirements and guidelines. Sept. 1993). not 
only discards edge information that might be available in tiie causal tenplate, but produces very different compression 
results depending on the selected predictor. Moreover, the best predictor depends heavily on the image. 

Accordingly, it is desirat)le to have an image compressor tiiat uses low-complexity predictors witii some degree of 

55 edge detection. 

The term low-corrplexrty" herein connotes an in^ge compression system which uses predictors based on addi- 
tions and shift operations, which avoids floating point arithmetics and general multiplications. It also implies a context 
determination process with simple comparisons, fixed tak)le look-ups, and no updating of complex underlying data 
structures. None of the atx>ve mentioned image compression schemes based on context nrxKlels achieve low-complex- 
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ity" as defined herein. 

ArthoughoptiTOl as a prefix code; a'Huffman (^ ... ».v....uj, 

was generated, if this distribution is very skewed. At least a one-bit code word needs to be assigned to every event, so 
that the average per-symbol code length cannot approach the entropy of the distribution whenever one event concen- 

5 trates more than half of the probability nnass. This is exactly the case in contexts representing smooth regions, lor which 
a prediction error value of 0 Is extremely likely. For some Images, the redundancy of the corresponding Huffman code 
would produce a significant deterioration of the compression ratio. In traditional (non-conditioned) Huffman codes, this 
problem is addressed through an alphabet extension in which blocks of data is encoded as '^uper-symbols." TTiis type 
of alphabet extension can t>e viewed as a means of spreading the excess code length of the Huffman code over many 

10 symbols, thus reducing the per-symbol redundancy. 

It would therefore be desirable to achieve the simplicity of Huffman coding with the nxxJeling power of context con- 
ditioning while still being able to maintain skewed distributions and a per-symbot code that approaches the entropy of 
the distribution. 

15 SUfilMARY OF THE INVEf^lON 

It is an object of the invention to provide a lew-complexity image compressor that achieves the compression ratios 
of conrplex image compressor systems. 

It is an object of the invention to provide a image compressor that combines the benefits of Huffman coding with 
20 contextual modeling. 

It is a further object of the invention to provide an image compressor that uses a low-complexity predictor that is 
sensitive to edges. 

It is an object of the invention to use kx^al gradients to determine the context of a pixel to be compressed- 
It is an additional object of the inventbn to quantize the context of a pixel to be compressed and use the quantized 

25 contexts to create and select look-up tables for prediction residuals. 

It is another object of the invention to overcome the minimum of one-tMt per pixel limitation of Huffman coding. 
The above and other objects of the invention are satisfied by providing an image compressor that has a context 
quantizer, a predictor, and a tat)le generator that builds Huffman tables based on the prot}ability distribution of errors for 
quantized contexts. The context is determined by the pixels in a template that includes previously encoded pixels. The 

30 context quantizer determines a quantized context of a pixel to t>e codified. The Image processor uses the context of a 
pixel to be compressed to predict the value of the pixel. The image compressor compares the predicted values of each 
pixel with the corresponcfing actual value. The en-ors are counted with respect to the particular quantized context to 
which the pixel belongs. At the conclusion of a first pass, the image compressor has probability distrbutions for the 
errors encountered with each quantized context The image compressor uses these probability distributions to create 

35 context-specific Huffman XabHes. 

In a second pass the image compressor uses the quantized context of a pixel to be coded to look up in the Huffman 
table tfiat corresponds to the quantized context the code corresponding to prediction en-or for the pixel. In one enrted- 
iment the image compressor uses an alphabet extension, embedded in its context nrKxJel, in specific low gradierrt con- 
texts to reduce the redundancy of the encoding. 

40 On the decompression side, the decompressor also has a predictor and a context quantizer. The decompressor 
determines the context of a pixel to be decoded by looking to the same context template as the one used by the image 
compressor. The context quantizer then determines which Huffman table In which to look up the error value conrespond- 
ing to the encoded pixel. The decompressor obtains a predk;ted value for the pbcel, using previously decoded pixels in 
the context template, and adds the error value to the predicted value to obtain the actual pixel value. 

45 Still other objects and advantages of the present invention will become readily apparent to those skilled in this art 
from the detailed description, wherein we have shown and described the preferred embodiments of the invention, sim- 
ply by way of illustration of the best mode contemplated t)y us of carrying out our invention. As will be realized, the inven- 
tion Is capable of other and different emtxxliments, and its several details are capable of nrxxiifications in various 
obvious respects, all without departing from the invention. Accordingly, the drawings and description are to be regarded 

50 as illustrative in nature, and not as restrictive. 

BRIEF DESCRIPTION OF THE DRAWIfsJGS 

The invention Is best understood by refemng to the drawings accompanying this specification in which like numer- 
55 als represent like elements. As a convention, elements bearing a reference numeral followed by a single or nuiltiple 
apostrophes is an kJentical element or similar to. but a variation of, the element bearing the nunr>eral wltfK)ut an apos- 
trophe and any other elements with the same reference numeral but having a different number of apostrophes. 

Rgure 1 is a bkxjk diagram of a typical lossless image compression scheme. 

Rgure 2 is a block diagram of an image compressor system according to a preferred embodiment of the present 
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invention. 

-Figure 3 Is a graphic depiction of a causal tennplate usekJ by th invention. * v-^-x^^^ > < 

Figure 4 is a schematic diagram of a predictor according to the present inventbn. 

Figure 5 is a schematic diagram of a control circuit producing a control signal used by the predictor of Rgure 4. 
5 Figure 6 is a schematic of a second control circuit producing a second control signal used by the predictor of Rgure 
4. 

Figure 7 is a block diagram of the context quantizer and pixel encoder of the image compressor system of Rgure 2. 

Figure 8 is a high-level block diagram of the context determination circuit of Rgure 7. 

Figure 9 is a schematic of a gradient quantizer of the context determination circuit of Rgure 8. 
10 Figure 10 is a logic diagram of quantizer for one gradient of the gradient quantizer of Rgure 9. 

Figure 11 is a binary tree of the image conpressor according to the present invention used by the image compres- 
sor to codify tuns" of pixels having the same error value. 

Rgure 12 is a block diagram of an image decoder accorcfing to the present invention and corresponding to the 
image compressor of Rgure 2. 
75 Figure 13 is a block diagram of the context quantizer and pixel decoder of the Image decoder of Rgure 12. 

Figure 14 is a block diagram showing the configuration of a near-lossless image corrpressor/decompressor system 
of the present invention. 

Figure 15 is a block diagram of a conputer system having an image conpressor and an image deconpressor 
according to the present invention. 

20 

DETAILED DESCRIPTION OF THE DRAWINGS 



TTie present invention is a system and method for lossless compression of continuous-tone images that combines 
the simplicity of Huffman coding with the conpression potential of context models. The conpressor of the present 

25 invention is based on a fixed context nxxJel, but is tuned for efficient performance in conjunction with a collection of con- 
text-concfitioned Huffman codes. The use of Huffman coding in conjunction with context-conditioning poses unique 
problems which are solved by the present invention. On one hand, the number of possible error events (the effective 
alphabet at each context) cannot be too large, as a different Huffman table needs to be designed for e^ context For 
the same reason, the number of contexts nrust be relatively small. On the other hand, the alphabet cannot be too small, 

30 for otherwise the recbindancy of Huffman codes (i.e., the excess code length over the entropy) increases. This redun- 
dancy vanishes only for distributions in which each prot>ability is a negative power of twa An additional fundamental 
limitation of Huffman codes is that they rec^ire a minimum code length of one bit per encoding, which may produce a 
significant deterioration in the compression ratio for contexts with very skewed distributions. 

By addressing and finding a solution to the above profc»lems, the present invention attains, at low complexity, com- 

35 pression ratios similar or superior to those obtained with more oonplex codes based on arithmetic coding, e.g., the fam- 
ily of Sunset coders. In particular, as discussed below, the present invention proves to have superior conpression 
performarx^e tfian the JPEG irxjependent lossless compression system at a k>wer level of complexity. 

Figure 2 is a^ljlodt^liagram o f an in^ geco mpressor system^20 1 according to a preferred embodiment of the 
present invention. Uncxxtipi ^sed j mages^e store d in an ima g e buffer 20 3. The image buffer is connected to a pixel 

40 sequence generator 205. The pixel sequence generator 205 is connected to a predictor 207 and to a context quantizer 
and pixel encoder 209. The predictor 207 operates to determine a predicted value for the pixel currently t>eing proc- 
essed, using its context The total number of possible contexts can t>e quite large. The context quantizer 209 operates 
to classify a partknjiar context as being one in a set of quantized contexts. 

In one embodiment, the image compressor 201 operates as a two-pass system. In the first pass the image com- 

45 pressor 201 counts the nunrber of occurrences of each error value for each quantized context At the conclusion of the 
first pass, the image conpressor 201 has produced probability distributions for the prediction residuals for each quan- 
tized context These context-dependent counts of prediction residuals are input to a coding table generator 21 1 , which 
builds Huffman tables based on the probability distributions of the prediction residuals. 

During the second pass, the image compressor system 201 , via the context c^antizer/ pixel encoder 209 uses the 

50 context-specific Huffman tables to encode the prediction residuals for each individual pixel in the image being com- 
pressed. The encoded image may then be decoded by an image decoder, such as the one shown in the block diagram 
of Figure 12. 

The pixel sequence generator 205 outputs a number of context pixels to the precfictor 207. Figure 3 is a graphic 
depiction of a causal tenplate 301 used by the present invention. Element 303, a pixel having the value x, is the pixel 
55 currently being processed. In the tenplate 301 , the value of the Tslorth " pixel 305 (the pixel above the current pixel 301 ) 
is denoted by a, the value of the 'West" pixel 307 (the pixel on the left) is denoted by 6, while the values of the TJW" 
(pixel 309) and 1ME* (pixel 31 1) pixels (the pixels on the diagonals) are denoted by c and d, respectively. The "East" 
pixel is not used, because it is unavailable to the decoder as it decodes the code string sequentially. Of course, a, b, c, 
and d depend on the time index /, but this dependence has been deleted from the notation for simplicity. 



5 



EP0755155A2 



Prediction 

The predictor 207 of the image corrpression system 201 employs a simple test to detect vertical or horizontal 
edges. If an edge is f)oX detected, then the guessed value is a+b-c, as this would be the value of 7 if a plane passes 
5 through the N. W, and NW pixel locations, with respective heights a. b, and c, and the current pixel is constrained to 
t>elong to the same plane. This constraint expresses the fact that the image is expected to be smooth in the absence of 
edges. Specifically, the predictor 207 guesses: 



1min(a,jb) if c^max(a,jb) 
max(a,jb) if c^min{a,b) 12) 
a+Jb-c otherwise 



15 



Assuming, without toss of generality, that a^b, then the predictor of (2) can be interpreted as picking a in many 
cases where a vertical edge exists left of the current location, b in many cases of an horizontal edge above the current 
location, or a plane predictor (i e., snrxxsthness is assumed) if no edge has been detected. 
20 In an alternative embodiment d is used by the predictor 209. By utilizing d the predictor 209 better identifies edges. 
In this embocfiment the predictor 209 obtains first-order entropy of prediction errors which are smaller than when using 
equation (2). This predictor can t>e expressed as 



25 



30 



X = 



max(a',jb) if a + b-c ^ max(a',jb) 
min(a',jb) if a+b-c ^inin(a',Jb) 
a+jb-c otherwise 



(3) 



(a^d)/2 



if |a-d|<4|a-c| A sign{a-d) =sign{c-'a) 
otherwise 



(4) 



35 Figure 4 is a schematic diagram of the predictor 207 using the equations (3) and (4). A circuit 401 produces the 
auxiliary signal a. The circuit 401 accepts the a and d input values. These values are added by an adder 403; and 
divided in two by a shift register 405. The resulting output is multiplexed with the value a t>y multiplexer 407. The control 
signal Y1 for the multiplexer is produced by a controller 409. If the control signal Y1 is 1 , the output from shift register 
405 is output as the auxiliary signal a\ othenvise the value a is output as auxiliary signal a\ 

40 The control signal Y1 is produced by a control circuitry 501 shown schematically in Figure 5. The control circuitry 
501 accepts as input the values a. c. and d. The value d is subtracted from the value a t>y a subtractor 503. Similarly, 
the value a is sibtracted from the value c by a subtractor 505. The resulting values are fed into absolute value units 507 
and 509. respectively. The output from the absolute value unit 509 is fed into a shift register to be multiplied by 4. The 
output from the shift register 51 1 and the output from the at)solute value unit 507 are both fed into a comparator 513. 

45 The output of comparator 51 3 is 1 if \a-d\ <4|a-c| and 0 otherwise. To determine whether the signs are equal for the 
two temns a-d and c-a the sign bit of each subtractor 503 arxl 505 output is extracted 515 and 517 and these sign bits 
are compared by a comparator 51 9. The output of the comparator 51 9 ^ 1 if the two sign bits are equal arxJ 0 otherwise. 
The outputs from the conparators 51 3 and 51 9 are AIMDed t>y AND gate 521 to produce the control signal Y1 . 

Returning to Figure 4. The circuitry 41 1 is connected to the circuitry 401 via signal a'. The circuitry 41 1 determines 

50 the predicted pixel value based on the context pixel values a. b, and c. and the value a\ The drcuitry 41 1 calculates 
three alternative values representing the three alternatives of equation (3). The first alternative value is produced by 
adding values a and b by adder 413 and feecfing the resulting sum and the value c to sut)tractor 415. The subtractor 
output is then fed as a first input into a multiplexer 417. The second and third alternative values are the minimum and 
rrmimum values of values a' and b. These are produced by units 419 and 421 , respectively. 

55 The control signals Y2 for the multiplexer 41 7 are produced by a second control drcuit 423. The inputs to the control 
circuit 423 are the minimum arid maximum values of values a' and b. output from units 419 and 421 . respectively, and 
the output from the subtracter 415. The control circuit 423 is shown in greater detail in Rgure 6. The control circuit 423 
consists of two comparators 425 and 427. Each of the comparators is connected to the signal a+b-c , output from sub- 
tractor 415. The comparator 425 is connected to the max(a\b) signal and outputs a 0 if the result a+b< is less than 
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the maximum of a' and b, and outputs a 1 , otherwise. The comparator 427 is connected to the min(a',b) signal and out- 

V „ puts a 0 if the result a^tx is greater than the minimum of a' and />, and outputs a 1 otherwise E The control signal V2 .v 
is the combination of the outputs from the comparators 425 and 427. 

If the control signal Y2 is 00, indicating that min(a',b) < a+b-c < max(a\b) , the predicted pixel value is the result 

5 a+b< . If Y2 is 01. indicating that en-b-c^ min(a)b) , the predicted pixel value is the minimum of a' and b. Othenvise, 
Y2 is 10, indicating that a+b-c ^ max(a\b) , and the predicted pixel value output by predictor 207 is the maximum of a' 
and /?. If Y2 = 1 1 , then a + b - c = min(a',b) = max (a'.b) . and any of the inputs can be selected. e.g., maxCab). 

Figure 7 is a block diagram of the context quantizer and pixel encoder 209. The context quantizer/pixel encoder 
consists of five major units, namely, an error circuitry 701 . a context determination circuitry 703. a context-indexed coun- 

10 ter 705. an encoder 707. and a coding table selector 709. The current pixel and the predicted value (from the predictor 
207) are input to a subtractor 71 1 of the en-a circuitry 701 to determine the prediction residual or predictbn error. As 
is disclosed below in conjunction with Rgure 9. depending on which quantized context the current pixel's context is a 
member of, either the en-or (e) or the opposite value of the en-or (-e) is encoded or counted. Therefore, the negative of 
e is produced by unit 713. and both values are fed into a multiplexer 715 to be selected by a control signal {reversed) 

IS from the context determination circuitry, which outputs the error quantity e which is to be counted (by pass 1 of the 
image compressor 201) or encoded (during pass 2). 

The error quantity e is fed into both the context-indexed counter 705 and the encoder 707. These are enat)led or 
disat)led depending on which pass the image compressor 201 is operating by a pass signal. 

20 Parameter Reduction: 

Reducing the number of parameters is a key step in a context nxxteling scheme. In a sequential formulation, the 
goal is to avoid "context dilution, " while in a two-pass scheme we wish to reduce unnecessary taUe overhead. The total 
nunrt>er of parameters In the nxxJel depends on the number of different error events considered at each context, and 

25 on the number of contexts. 

One method of the image conpressor 201 is Alphabet reduction. Let A denote the total number of different pixel 
intensities, which is assumed to be a power of two (e.g..y\=:256 for d-t>it pixels). In principle, the error residuals may take 
on values in the range [-^-i-l, A-1]. hbwever, given the predicted value, only A residuals witfiin this range can occur, and 
it is easy to see that the decoder only neecfe {et+i mod A) to recover This modular reduction amounts, in a 2's 

30 complement representation, to just ignoring any carry to the log A -f 1 st bit Thus, the image compressor 201 makes use 
of the fact that prediction residuals are integers between -A/Z and A/Z-l , represented with log A bits. 

Assuming that the predklor indeed makes reasonable guesses, the distribution of predictbn residuals is usually 
skewed, peaked at 0, and decaying rapidly for large prediction residual magnitudes. Thus, it is unwise to build Huffman 
codes for the entire set of A possible error events (one code for each context), as most of these events are expected to 

35 occur with very low probability. Instead, the image compressor 201 considers the following possitrfe events for the error 
value e/+|: ^- 

-less than (- T) \ - r, - 7+1 -1 .0,+1 7-1 . 7. "greater than r (5) 

40 where 7 is a threshoM parameter used to tune the image compressor 201 . For A = 256. T=8 proves to be a good empir- 
ical choice, thus leading to 19 possa3(e error events per context. Of course, if |e/+r| happens to be larger than 7. the 
decompressor system still needs to be informed of the exact absolute value of the prediction residual (the sign is 
already given by the "smaller than (- T) " and "greater than 7. " events). Because this is an unlikely event, an image com- 
pressor 201 according to the present invention saves parameter resources' by encoding all the occurrences of large 

45 prediction residuals using a single distrilxjtion, regardless of the context at whk;h the events ''e^^t<-T. " or " e/+7>T.* are 
encoded. 

After a prediction residual is identified to be large.^ /2-T possible values (representing the absolute value of the 
error) need to be assigned code words, with the encoder 707 in a large error' state. Again, very large residuals are 
extremely unlikely, so the present image conpressor 201 uses a further reduction of the con-esponding Huffman table, 
50 which consists of the values: 

7+1, r+2 B^^Bi-h (6) 

where B is a parameter. For i4 = 256. B = 64 is a good empirical choice. 
55 If an error residual happens to be at least 8+1 . then the corresponding Huffman code word is folkwed by the binary 
representation of the value (|e| - B - 1) to flog {AI2 - B)1 t)its (e.g.. 6 bits for A = 256) to indicate the exact enror value. 

By (5) and (6). the image compressor 201 requires a (2 7+3) -entry Huffman table (typically, 1 9 entries) per context, 
together with a single (S-r+1)-entry Huffman table (typically. 57 entries for A= 256). As is discussed below, two other 
types of Huffman tables (resulting from extending the reduced alphabet) are also used. These Huffman tat)les are 
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stored in atable array memory 711. 

' ^^^TTief corrt€Drt1hat dbrtditiohis the eilcoding of th'e'^current prediction residua) in the image 'c6hpirSBSs6r20 ' >vr;.>v>^,>. 

to the present invention is txjilt out of the differences = d-a, Qg = a-c. and g3 = c-b. Intuitively, these differences 
represent the local gradient, which govems the statistical behavior of predictton errors. By symmetry, the three differ- 

5 ence values influence the model In the same way. In the image compressor 201 , parameter reduction is obtained by 
quantizing each difference into approximately equiprobable regions. In a well-defined mathematical sense, this maxi- 
mizes the mutual information between the current pixel and its context, an information theoretic measure of the anfx}unt 
of information provided by the concfitloning context on the pixel value to be modeled. 

According to the present invention, low complexity of tfie image compressor is achieved by quantizing the context 

10 based on a fixed number of "equiprobable" regions. By symmetry, there Is one region centered at the difference value 

0, and if the interval [rpfg] represents a region, then so does [-r/, -r^]- Thus, the total number of regions is an odd integer 
2R+1 and, in principle, this would lead to a total of (2R+1 f different contexts, where R is a parameter that controls the 
nurTt>er of quantization regions. Hcwever. again by symmetry, it is reasonable to assume that 

15 Prob{e^^ = D I C,- - [Q,, q^, ]} = Prob{e^, = ■ D | = [-g,, - q^. "Qsl} (7) 

where 0/ represents the context triplet at time I and qj, j= 1,2,3, are quantized differences corresponding, respectively, 
to Qp 7 1 , 2, 3 (parenthesis are used herein to denote the triplet of gradients (g^ , gg, gs) and square brackets to denote 
its quantized counterpart [Qy , q^- QsD- Using this equality, the image compressor 201 reduces the number of contexts 
20 to ((2R+1) ^-1)/2+1 . In a preferred embodiment the image compressor 201 uses R=1 , which results in 14 different con- 
texts. 

Each quantized context is represented by a three<limensional vector [q^, qg, qs]. For each non-zero vector, there 
is a vector with the same magnitude but exactly opposite orientation. The contexts represented by these opposing vec- 
tors are considered a quantlzed-context pair, and in one embodiment of the image compressor 201 . only one Huffman 
25 table is generated for each pair. Notice that, by merging symmetric contexts, the encoded value may actually be the 
opposite of the prediction residual. For exanple. with R=1 . let (-f ). 0, and {+1) denote the three context regions (denot- 
ing 'Yiegative.' "around zero," and "(positive, " respectively). If a residual of. say. 4 is encoded as such at context [- 

1, +1,0], then a residual of. s^. 3 at context [+1,-1,0] , Is actually encoded as a (-3). with the same tak>les as the former. 

To complete the definition of the contexts in an embodiment of the image compressor 201 with R=1, a parameter 
30 S specifies the value that determines the bourvJaries between quantization regions. The central regbn is formed by 
thiose difference values A such that -S<A <S. It turns out that the optimal value of S depends heavily on the image. For 
many images a reasonable choice is s=7. For some srTxx>ther images this selection will tend to concentrate most of the 
pixels in the central region (i e., contexts like [0,0.0] or [0,0,+1]), while contexts like [-1,+1.+1] tend to be under-popu- 
lated. In the present invention, a solution to this problem is obtained by choosing a relatively large boundary value (e.g.. 
35 S=7 as a default), and then subdividing the "central context" [0.0.0] by recursively applying the same scheme with the 
boundary parameter Thus, the total number of corrtexts is augmented to (2R+1)^ (namely, 27 in one preferred 
embodiment). As is discussed below, under-populated contexts may be encoded with a fixed code, thus saving unnec- 
essary table overhead. 

Rgure 8 is a high-level t)lock diagram of the quantizer 703 of Rgure 7. As discussed above, two levels of quantiza- 
40 tion are performed, one using S and one. for a central context [0.0.0] using \-S/2X The former context quantization ts 
performed by a gradient context quantizer 801 and the latter (the sub<iuantization of the central context) Is perfonned 
by a second gradient context quantizer 803. Internally the two quantizers 801 and 803 are kientical and are shown in 
Rgure 9. 

The three gradierrts, d-a (g^ ), an: {g^, and c-b [q^), are determined by subtracters 901 . 903. and 905. respectively. 
45 These are each input to a "±S" quantizer 907 (907a. 907b. and 907c, respectively). Each of the "±S" quantizers 907 are 
internally kientical arxJ an exemplary "d:S" quantizer 907 is shown in Figure 10. The "±S" quarrtizers 907 input a gradient 
gj and the parameter S and its negative (-S). The "±8" quantizers 907 consist of two comparators 1 001 and 1 003. whk;h 
operate to produce a two-bit output signal (?/ having a value "10" for gf, ^ -S. tM)" for ^ < < S, and "01" for S ^ gj 
(these relatbnshlps con-espond to -1. 0. and 1, respectively, for the value of q^ in the preceding discussion). S Is 
50 assumed positive, so the combination "1 1" is not possible. 

Returning to Rgure 9, as discussed atxTve, there is a symmetry between quantized contexts, and the image com- 
pressor accor<fing to the present invention capitalizes on tfiat symmetry by only having one table for each pair of sym- 
metric quantized contexts. Therefore, quantized context signals, q,, are fed into a mapping table 909 which maps the 
quantized context with the appropriate Huffman table. As noted above, with R=1 there are 14 such tables. Thus, the 
55 context index output from tiie mapping table consists of lour t)its representing a number between 0 and 1 3. Additionally, 
there is a one-bit output, reversed, for indicating whether the index is for the "opposite" table. 
Table 1 is an illustrative example of the mapping tat)le 909: 
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Returning to Rgure 8, the context indexes from each of the gradient context quantizers 801 and 803 are fed into a 
multiplexer 805 for selecting which of the context indexes to t>e output from the context determination circuit 703. The 

50 multiplexer 805 is controlled by a comparator 807 which determines if the context irtdex output from gradient contact 
quantizer 801 is the "central" context If so, then the index from the sut>quantizer 803 is selected. The comparator 807 
also controls which of the reversed signals is output from context determination circuit 703. The two neversed signals 
are input into a multiplexer 809 which is controlled t3y the output of the conrparator 807. Thus, the reversed signal output 
by the context determination circuit 703 corresponds to the selected context index. The index signal out of 703 consists 

55 of 5 bits: 4 bits from the selected index, and one bit to indicate which one was selected. The 5 bit index takes on one of 
27 possil3le values. 
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Embedded Alphabet Extension 

The image compressor 201 of the present inverrtion addresses the redundancy of Huffman codes due to very 
skewed distributions, by embedding an alphabet extension Into the context conditioning. Typically, very skewed distri- 

5 butions occur in the context where the absolute values of the three differences {g^ , Qs) are small, as this indicates 
a smooth region. Moreover, this context often occurs In runs, l.e., there exist connected regions in the Image where 
every pixel occurs at the same (low-activity) context. This observation makes possible the implementation of an alpha- 
t>et extension, by considering runs of O-error values in the following manner. First, the low-activity'' context Is split into 
two separate contexts, one for the case where a=b=o=d (I.e., all gradients are exactly zero) and one for the other cases. 

10 In general, if a very skewed distritxjtion exists, after tiiis split it will be nrK)stty associated with the zero-gradient context. 
Thus, occurrences at the remaining context are encoded with the non-extended (reduced) alphabet and. for R=:1, the 
number of contexts using this alphabet remains 27 (or 14, If the option of furttier partitioning the 'central context" is not 
employed). For tiie zero-gradient context, tiie extended alphab^ is represented with the tree 1101 shown in Figure 1 1 . 
Leaves 1103 -1121 ofthetreellOl represent the events to be encoded. Notice tiiat if x/^^ occurs at this context, tiien, 

15 clearly, 

20 If the prediction residual e,;^} is non-zero, a leaf Is reached and a single pixel is encoded. But if, as expected, a 0-error 
occurs (i.e.. x^^^, then the pixel East of d Is considered. Dearly, if its value equals d, then x^^ occurs at the 
zero-gradent context. In this case, we can search for longer runs by traversing the tree 1 101 ; othenivise, a run-length 
of 1 is encoded. If the tree is traversed and x^^ ^ d. the run is broken and a run length of 7 is encoded (a leaf was 
reached). The prediction residual Xi^2 ' d is then encoded at a new 'end-of-run " state, for which the distribution does 

^ not include the event 0, This new state incorporates the information that is not d, which otherwise would be lost 
and the code would be redundant. If, again, as expected, x^^ = d , then the tree indicates that the run-lengtii is at least 
two. and the process continues until one of the following contingencies occurs: 

a. A predetermined maximal run length r is reached (the default value in our current Implementation is r-6). The r 
30 consecutive 0-enror values are encoded as a single event, and the next pixel Is either encoded at one of the 27 (or 

14) ordinary contexts, or starts a new run. This is indicated by leaf 1121. 

b. The run Is broken by a non-zero error value, e.g., leading to leaf nodes 1 1 1 5, 1 1 1 7. or 1 1 1 9. The accumulated 
run is encoded as a single event and the pixel that breaks the run is then encoded at the "endK>f-run' state 1 123. 

c. The next NE pixel breaks the run of zero-gradient contexts. The accumulated run is encoded as a single event 
35 and the next pixel is encoded at an ordinary context. 

The alphabet extension procedure contains a certain amount of redundancy. That is due to the iad that the infor- 
mation needed to deternrune whetiier a run will be broken due to contingency c, is already availatsle to the decoder at 
the beginning of the run. Thus, the decoder is at)le to predetermine that longer runs cannot occur and does not need to 
40 reserve coding space for these events. This redundancy can be easily removed as discussed betaw. 

In a prefenred embocfiment tiie maximal run length reflects experimental results, which irxJicate that for nK>st 
images r=6 produces an acceptable reduction In the redundancy of the Kiuffman code at the zero-gradient context. This 
is also the case for images witti long runs, which are frequent for exanrple in digital radiology. 

To summarize, the proposed alphabet extension, which is embedded irrto the context model, requires two addi- 
45 tional distributions: one for the zero-gradient run-oontext and one for an end-of-run state. The alphat>et size for the 
former is 2T+r+2 . while for the latter it is 27-1-2. With the default parameters T=8 and r=6, these require 24 and 1 8-entry 
Huffman tables, respectively. 

Huffman coding 

50 

Above is descrit^ a procedure under which the Image compressor 201 in compressing a pixel, or a string of pix- 
els, yields one or more of the following encoding actions (numbers of events are computed using the default parameters 
for A = 256: 

55 a. An event out of 19 is encoded at one of 27 (or 14) possit)le contexts (small prediction error at ordinary context). 

b. An event out of 57 is encoded (big prediction enror). 

c. An event out of 24 is encoded (a possibly aborted run at the zero-gradient context). 

d. An event out of 1 8 is encoded (end of run state). 
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Thus, the present iniage compressor 201 manages 27 (or 14) 19-entry Huffman tables, as well as single 57-entry, 22- 
- entry, and 1 8-entry Huffman tables: These tables are stored in the table array memory 71.1r>fn a preferred'embodiment; " • ? - ; * ^r^r- p. -.j-v^-i > 
the image compressor 201 operates In two passes: one for collecting the statistics from which optimal Huffman codes 
are built, and a second one for encoding the data through table look-up. The codes must be transmitted to the decoder, 
5 which then proceeds sequentially, in one pass. One-pass encoding alternatives are described below. Because the total 
number of events to which Huffman codes are associated can be up to 612 in a 27-context version, special attention 
must be given to whether a Huffman code should be completely described, and how. This issue is especially important 
in small images, for which excessive table overhead may offset the savings obtained through context conditioning. 
Therefore, in one embodiment, image compressor 201 compares the compression achieved using various combina- 
10 tions of tables, such that table-overhead can be minimized. In some cases, the compressor 205 might decide not to 
send a table, and revert to default tables known to both the compressor and decompressor, or to send a slightly mis- 
matched table with a shorter desaiption. In both cases, the slight loss in encoding length is offset by gains in table over- 
head. All the table information is availat)le to the encoder at the end of the first pass, before encoding. 

IS Efficient Code Description 

A Huffman code is completly specified by describing its associated binary tree and the conrespondence between 
symbols (or events) and leaves of the tree. A complete binary tree having L leaves, /. ^ 2, can be described with 2L^ 
bits. A straightforward way to construct such a tree consists in constructing a binary sequence by visiting the L-1 inter- 

20 nal nodes sec^entially, starting at the root and traversing each level of the tree in lexicographic order. Each node is 
assigned two bits, one per child. A "0" denotes that the associated child is a leaf, while a * / " corresponds to a chiM that 
is an internal node. The two bits corresponding to the last visited internal node are ignored, as they are always both "t). ' 
Next, the leaves of the tree are mapped to the symbols of the alphat)et. which constitutes the expensive part of the code 
description. Having collected the statistk:s and computed optimal Huffman codes, the image compressor 201 takes into 

25 consideration three coding alternatives for the 2T+3 possit)ie events at each ordinary context: 

a. It assumes that for every non-negative integer t 

Prob{e^, = 1 1 C,} ^ Prob{e^, - f + 1 I (8) 

30 

and 

Prob{e^, = -f I C,} ^ Prob{e^, = -f - 1 1 C,} (9) 

35 Under the constraints (8) and (9), a ranking of the en-or probabilities t>y decreasing values needs only 2T bits to be 
desaibed. provided that the position of the "e/^^ > T" and "e/^y < -7; " events in the ranking is specified, which takes 
another nog(2rf3)1 bits. Thus, by adding the Huffman tree description (27+2 bits), the code can be specified with 
a total of 

^ 6T +2 flog(23V3)l +2 

bits (namely, 60 bits with T=8). Of course, if (8) or (9) do not apply to the statistk;s collected in the first pass, the 
resulting code is not matched and the code length will not be optinnal. However, in rnosil cases these constraints 
45 either do apply or are sligfitly violated for some value of t cbse to 7. In under-populated contexts, the resulting 
excess code length is usually smaller than the savings resulting from an incomplete code description. 

b. No assuirptions are made, and the code is fully described by appending to the tree representation a listing of the 
27+3 events, ranked by decreasing frequencies. For simplicity, a full byte is used fa each event. An additional one 
bit specifies whether the code description is partial (i.e.. the assumptions of a. above are used) or full. 

50 c. A fixed table, known to both the encoder and the decoder, is used. This alternative saves table overhead for con- 
texts that occur only a small number of times. For example, for T^, a possfole code can assign code words of 
length 3 to the events 0,1 , and -1 , code words of length 4 to the events 2. -2,3, and -3. and code words of length 5 
to the other events. The tables are preceded by one bit per context, specifying whether fixed or customized Ce.. as 
in alternatives a. or b.) tat)les are used. 

55 

The image compressor 201 uses a similar procedure for the distribution at the end-of-run state. For the run state (zero- 
gradient context) and for the single distribution correspondng to values of e/+y larger than 7. only the last two alterna- 
tives are considered (with different fixed codes). At the end of the first pass, the encoder decides for the alternative that 
results in the shortest code length, and the decoder is informed of the codes to be used in the second pass. 
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The method of operation of the image compressor of the present invention 

The sequentia) steps image compressor 201 follows, in its two-pass form, are desaibed t>elow. For simplicity, we omit 
spedal cases such as the treatment of the boundaries of the Innage. Thus, we assume that the surrounding pixel values 

5 a, c, and d are well-defined for the processed pixel Xj^^. For example, it can be assumed that all pixels outside the 
image boundaries are zero. For Illustrative purposes, the context quantization assumes R=1 . 
TTits method may be carried out on a general purpose conrputer having, e.g., a central processor, a random access 
memory, a read-only memory, a number of input/output devices, a video menfx>ry This computer may be connected to 
other computers via a network such as a local-area network (LAfsQ. a wide-area networK or via a communications links 

10 such as telephone or cable-television networks. Alternatively, the method may be carried out on a special purpose 
devk;e such as a medical imaging system. In either application the method may either be software instructions loaded 
into the systems memory and executed by the central processing unit, may be implemented using the hardware embod- 
iments described above, or may be stored in a read-only memory as firmware. 

75 Method: 

Step 0. Define a first alphat)et reduction threshoM 7, a second alphabet reduction threshoM 8. a maximal run 
length r. and a context quantization threshokl S. The defaults for these parameters in a preferred embod- 
iment are 8, 64, 6, and 7, respectively. Specify whether recursive subdivision of the 'central context" is 
20 desired (27 -conteict option, as opposed to the basic 14 contexts). Allocate occurrence counts for 2T-t3 

events at each context, for 8 - 7 -i- 1 events in the single distritxition of large error values, for 2 T+2+r 
events at the run state, and for 27+2 events at the end-of-run state. Transmit to the decoder one bit indi- 
cating whether the default parameters are used. If some ron-default parameter is selected, transmit the 
values of the parameters. Use another bit to indicate either 27 or 14 contexts. 
25 Step 1 . Having processed the pixel sequence V, start processing for the next pixel x/^^^. At the erKl of the image, 
go to Step 14. Given the values a, b, c. and cf of the surrounding neighbors, compute the corresponding 
differences d-a and c-b (a-c is already available after processing x/). 

Step 2. Predict x/+| as x ^/ according to (2). or (3) and (4). 

Step 3. Read x^y from the input and compute 



30 



35 to log A bits. 

Step 4. By comparing their values to a threshold S, n^ the context differences to the quantization regions -1 , 0, 
arxJ +1 , thus ot>taining a context triplet C, ^ ^,q^,q^] . if the first non-zero component of the triplet is - 
1, change alt the signs in the trplet and associate a negative sign to it. Otherwise, associate a positive 
sign. 

40 Step 5. If the 27-context option is used (rather than 14) and Q is the "central context" [0.0,0], repeat Step 4 with 
the threshokl parameter [Sf2\. 
Step 6. If the negative sign is associated with C,. then e/^^ <- -e^/. 

Step 7. If a=b=c=d . take the encoder into the "irun" slate (Step 10). Otherwise, stay in the "ordinary context" 
nKxie (Step 8). 

45 Step 8. In the ordinary context nxxle. if je^y | ^ T then increment the count coaesponding to eyi^f at context C,, 
increment /, and return to Step 1. Otherwise, increment the count corresponding to either large positive" 
or Targe negative" error. 

Step 9. tf [6^.71 ^ B, increment the corresponding count in the distribution for large errors. Otherwise, increment 
the count corresponding to le^^y | > B. Increment / and return to Step 1 . 
50 Step 1 0. In the run state, if e^+y 0 proceed as in Steps (8) and (9). Use the counts conresponding to the run state 
and, if necessary, the distributfon of large enrors. 

Step 1 1 . Othenwise. if e/^y =0 increment a run-count If the value of the next NE pixel equals d. read and incre- 
ment /. Otherwise, skip Step (12). 

Step 1 2. Repeat Step (1 1 ) until the processed pixel ^ not d. or until the run-count reached the allowed maximum r. 
55 Step 1 3. Increment the occurrence count corresponding to the total run length detected in the run state counter. If 
the last read pixel is not d. incren^ent the corresponding count in the end-of-run state. If necessary, incre- 
ment also a count in the distribution of large errors. Inaement / and return to Step (1). 

Step 1 4. Once the first pass is complete, conpute the Huffman codes for all the distributions stored. For each code, 
compute the code lengths corresponding to the representations described above in the sections of "Huff- 
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man Coding" and "Efficient Code Description" and select the one that results in the shortest code length, 
-i^ > ' V :t>'v.i;: virn^^^^^ code,' Whether customlzed or fixed tables are usedr'^-*?^-'"^^ 

For each customized code, transmit the desaiption of the Huffman tree. For the ordinary contexts, trans- 
mit a bit indicating whether full or partial table description is used. Then, describe the frequency ranking. 
5 Step 1 5. Perform the second pass similarly to the first one, but Instead of inaementing occurrence counts, transmit 
the corresponding code word. If Step (9) is executed and |e/^y| > B, transmit also a flog N2 - STbit rep- 
resentation of |e/+^ I -B-1 . 

Figure 12 is a block diagram of an image decoder 1201 corresponding to the image compressor 201 . The decoder 

^o 1201 accepts a compressed image from the image compressor 201 and stores this compressed image in a com- 
pressed-image buffer 1203. The Huffman coding tatties used to compress the image are transmitted from the image 
buffer 1203 to a context c^antizer and pixel decoder 1205. The tables are the Huffman tables generated by the image 
compressor 201 . The context quantizer determines the context of the pixel to be decoded in the same manner as the 
image compressor 201 . However, to obtain the context for the pixel, the image decompressor 1 201 utilizes a pren'ously 

75 decompressed sequence of pixels. Therefore, when a pixel has been decoded it is transmitted from the context quan- 
tizer and pixel decoder 1 205 to a decompressed image buffer 1207. A pixel sequence generator 1 209, connected to the 
decompressed image buffer, transmits the context pixels, a. b, c, and 6 (as defined above in the description of image 
compressor 201). to a precfictor 121 1 . The predictor 121 1 uses the same method as the predictor 207 of image com- 
pressor 201 to determine the predicted value, which together with the context, a, b, c, and d, is fed into the context 

20 quantizer and pixel decoder 1 205. 

Figure 13 is a block digram of the context quantizer and pixel decoder 1205. The unit 1205 receives the context 
values a, b, c, andi d from the pixel sequence generator 1209. These context values are fed into the context determi- 
nation unit 703' which operates like unit 703 (descrit>ed above in conjunction with Rgures 7, 8, and 9). The context 
determination unit 703* outputs a context index and a reversed signal. The context index is input into the decoding table 

25 selector 709*, which uses the irxJex to fetch the appropriate Huffman table from the table array memory 71 1 *. The table 
array memory 71 1 * is similar to the table array memory 71 1 . but because coding arxl decodng m^ occur on different 
machines, these menraries are often not the same menrK>ry. Also, encoding and decoding tat3les carry the same infor- 
mation but may have different formats optimized for the operation at harxi. 

The decoding table selector 709^ feeds the appropriate decoding table to the decoder 1 301 . The decoder 1 301 also 

30 receives the encoded pixel value, y. and looks up the con^esponding code in the decoding table. The sign of the value 
e is reversed by sign change unit 713' and both the value e and its negative are fed into and selected by a multiplexer 
715* which is controlled by the reversed signal. The output from the multiplexer 715' e is added to the predicted value 
ir/by an adder 1303 to produce the decoded value x,, which is fed into tiie deconrpressed image buffer 1207. 

The context quarrtizer portion of unit 1 205 operates according to the same method as the context quantizer of the 

35 image compressor system 201 . Thus, the context quantizer determines whk;h Huffman table to use to look-up the enor 
corresponding to the compressed pixel value y. Having looked ip tiie error value e. the pixel decodcar 1205 adds tiiat 
quantity to the predicted value Xf. 

The following decoding metiiod assumes tiiat the various Huffman codes are represented by their binary trees with 
labeled leaves. In one afternative suitable for faster decoding, the first action that the decoder takes is to translate the 

40 compact descrptions generated by tiie encoder into nrv>re easily accessible tables. 

Decoding method: 

Step 0. Retrieve tiie parameters T, r, and S, and use the header information to build the Huffman trees. 
45 Step 1 . Having decoded the pixel sequence V , start decoding of the next code word. Given tiie values a, b, c, and 
d of the sunrounding neighbors, compute the conesponding differences d-a and c-b (a-c is already avail- 
able). 

Step 2. Execute Steps 4, 5, and 7 of the image conrpression metfxxJ described at>ove to determine the context 
C/gits sign, and tiie mode (run state (step 4) or ordinary context (step 3)). 

50 Step 3. In the ordinary context mode, traverse the Huffman free corresponding to 0/ following the encoded bit 
stream, until a leaf is reached. If the leaf indicates that \ei^i\>T, furtiier follow the encoded bit stream to 
traverse the Huffman tree corresponding to the distribution of large errors. If. again, the decoded code 
word indicates tiiat \ei+i\ > B , read tiie next flog (A/2 - 8)1 bits to conpute the exact value of e^^. If ttie 
negative sign is associated witii C/, tiien change the sign of ef+i. Rnalty, compute Xj^^ according to (2) or 

55 (3) and (4) (deperxJing on which predictor has been adopted) and output 
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Inaemertt / and return to Step 1 . 

until a leaf is reached. If the leaf irxiicates a zero-length run, proceed as in Step 3. Otherwise, output as 
many pixel values d as indicated by the leaf and increnr^ent / accordingly. If the tcAal run-length is r, or if the 
5 next NE pixel is not d. return to Step 1. Otherwise, further follow the encoded bit stream to traverse the 

Huffman tree corresponding to the end-of-run state, proceed as in Step 3 to obtain ej+t, and output 
x^, = e^, + <y . Inaement / and return to Step 1 . 

Experimental Results 

10 

The present Invention has been implemented in a system referred to t>elGw as LOCX)^l (Low Complexity, Context- 
Based, Lossless Image Compression). Table 2 is a comparison of compression results achieved by LOCO^I and sev- 
eral other image compressors. The results reported below were achieved using the basic configuration of the present 
invention as discussed above in conjunction with Rgures 1-11 for compression of a set of gray-scale images digitized 
75 at 8 bits per-pixel. This set includes standard images, as well as medical, satellite, and (mosaic) digital camera images. 
Preliminary results on RGB color images are discussed beAoH In conjunction with a cfiscussion of alternative emtxxii- 
ments to the k>asic configuration which improve perfonrnance with color images. Specifically, the set of test gr^-scale 
images reported on in this section is composed of: 

20 a. The 576 rows by 720 columns color test images from the JPEG standards committee, represented in the YUV 
system, with the chrominance components U and V sutisampled to 576x360 and each conrponent considered sep- 
arately as a gray-scale image. 

b. The 512x512 gray-scale standard images from the USC data set. 

c. Medical (MRI, X-ray, arxJ ultrasourxJ) images. Hie MRI images (human brains and a sequence of head slices) 
25 have dimensions 256x256. The X-ray images tested (human bone and lung) are 1024x1024. The ultrasound 

images, in turn, are 480x512 renderings of human hearts. 

d. A set of seven 480x640 images of the planet Neptune obtained tiy the Vbyager spacecraft. In addition to the main 
image object the image files corrtain textual arxi graphic information near the edges. 

30 



Table 2 



50 



55 



Image 


Diff. Context 
BT/CARP 


LOCO^I 


Sunset 


Lossles 
sJPEG 


7-Pass 
JPEG 


DPCM 
Entropy 


bart>2Y 


4.56 


4.84 


4.81 


5.26 


5.26 


5.44 


balloon V 


2.28 


2.42 


2.42 


2.57 


2.57 


2.82 


girlU 


2.78 


2.85 


2.87 


3.03 


3.03 


3.04 


hotel Y 


4.26 


4.47 


4.48 


4.89 


4.89 


4.95 


hotel V 


3.25 


3.35 


3.37 


3.99 


3.59 


3.59 


hotel U 


3.05 


3.14 


3.16 


3.37 


3.37 


3.43 


lena 


4.15 


4.33 


4.21 


4.65 


4.65 


4.61 


pyramid 


2.97 


3.11 


3.30 


3.51 


3.28( 4) 


4.14 


couple 


2.25 


2.48 


2.56 


2.74 


2.42(4) 


3.58 


MRI brain 


4.35 


4.62 


4.51 


4.9 


4.9 


4.96 


MRI head slice 


2.55 


2.81 


2.87 


2.97 


2.97 


3.66 


lung X-ray 


2.09 


2.37 


2.25 


2.41 


2.37( 4) 


3.11 


heart uttraso und 


3.04 


3.27 


3.31 


3.52 


3.30( 1) 


4.17 


Neptune (Voyage r) 


3.04 


3.26 


3.54 


3.69 


3.56(4) 


4.33 



In TatHe 2, a representative subset of these images is considered. In Table 2, for each image considered the compres- 
sion ratio (bits per pixel - lower numt^ers are better than higher numbers) is given for several image compression sys- 



14 



EP0755155A2 



terns. The images listed in Table 2 are shown in Appendix A. This set of images coincides with those reported in 
^vWeinberger;^etv al :i>and provides a >k>asis for^ comparison with • a^ slate^rf-the-art' versioni! of ^the«^Smset ^algorithm - as ^^^^t^v- w >v;^ r;-\ . ^ . 
desaibed in G.G. Langdon. Jr. arxl M. Mareboyana, "Centering of contexKlependerrt components of prediction error 
distributions, " In Proc, SPiE (Applications of Digital Image Processing XVI), vol. 2028, pp. 26-31. In addition, these 

5 results are compared with the JPEG independent lossless compression system (described in ISO/IEC 10918-1 ITU 
T.81. Digital conpression and coding of continuous tone still images - Requirements arxJ guidelines, Sept. 1993). The 
results reported in Table 2 for the Sunset algorithm (which are taken from Weinberger et al.) correspond to computed 
ideal code lengths, i.e., negative logarithms of the probabilities assigned by the algorithm to the data. An additional 
overhead is expected after following the modeling step by an arithmetic Q-coder or QM-coder. In G.G. Langdon, Jr., A. 

10 Gulati, and E. Seiler, "On the JPEG model for lossless image compression," in Proa of tfie 1992 Data Compression 
Conference, (Snowbird. Utah, USA), pp. 1 72-180, Mar. 1992, the reported overhead (for an older versbn of the Sunset 
algorithm) averages 3.5% for the Q-coder and 2.S% for the QM-coder. As for lossless JPEG, the results reported in 
Tat)le 2 used arithmetic coding with the default parameter values: predictor number 7, namely (a4b)/2 , upper bucketing 
parameter equal to 1 , and lower bucketing parameter equal to 0. As a reference. Table 2 also contains an additional col- 

15 umn which covers the (quite unrealistic) situation where the best predictor for each specific image, out of the seven 
starxJard predictors proposed In JPEG, is selected. This scheme is referred to as T-pass JPEG. ' The digit in paren- 
thesis represents the optimizing predictor, in case it is not 7. The results obtained with DCXT-BT/GARP. the best of the 
universal context nrx)deling options proposed in Weinberger et al., are also reported as a benchmark On the other 
e)ctreme, we give first-order (unconditioned) entropies of the prediction residuals after applying the default JPEG pre- 

20 dictor (a-tt))/2 . This column is named "DPCM entropy." A comparison of the various algorithms on the complete sets 
(including images not reported in Table 2) yiekis similar results, and is summarized in Tat)le 3. Excluding DGXT- 
BT/CARP from the comparison, Table 3 shows that the t>est compression ratios are obtained with LOCO^I, despite 
being less complex than the arithmetic-coding-t^ased algorithms. 



25 

Table 3 



Image 


Drff. Context 
BT/Carp 


LOCO^l 


Sunset 


Lossle 
ssJPEG 


7-Pass 
JPEG 


DPCM 
Entropy 


JPEG (27 images) 


3.41 


3.55 


3.55 


3.82 


3.81 


3.90 


use (26 images) 


4.22 


4.34 


4.39 


4.7 


4.6 


4.86 


Mecfical (49 images) 


2.36 


2.61 


2.65 


2.72 


2.7 


3.38 


Space (3 images) 


2.91 


3.14 


3.41 


3.47 


3.43 


4.23 



LOCO^I has also been applied to two nK>sak: images, captured with a Kodak digital camera. Each innage was com- 
pressed as 4 independent gray-scale images (two shifted Green planes, one Red plane, and one Blue plane). The first 

40 image, a portrait, compressed down to 4.57 bits^ixel with LDCO^l versus 5.02 bits/|3ixel with lossless JPEG. The sec- 
ond image, a picture of an office cubicle at Hewlett-Packard Laboratories, yiekJed 4.52 bits/pixel for LOCO^I versus 4.81 
bits4>ixel for lossless JPEG. Despite the correlation reduction caused t>y the sut>-sanrpling process (a single image is 
compressed as 4 separate ones), the results obtained with LOGO^I are better than a 5:1 lossy JPEG compression, 
which requires an interpdatbn step with significant distortion. The reason is that the k>ssy JPEG algorithm is applied 

45 to complete color planes, so that the image to be compressed is formed by 24-brt pixels in total after interpolatbn. Thus, 
a 5:1 compression would reduce the total size only to 4.8 bits/jpixel. 

Alternative embodiments 

50 There are many possble variations of the present invention, some of which are mentioned in this section. Some of 
these depend on specif k; target applications sind on that applications particular complexity/compression constraints. 

In some cases, the edge detecting capabilities should be adapted to the specif k; conrpfexrty constraints. For exam- 
ple, predk;tors that use knowledge of the NE pixel value provkie better edge detection, as is the case with the predictor 
of (3). However, the crucial modeling step is performed by the context modeler, and the impact of better predictors may 

55 be limited and not merit tiie adcfitional complexity. The quantization of the context, in turn, may be affected by specif k; 
applications. For example, for some medical images the optimal value of the threshold S is smaller than the default S=7 
used in the description above of the image compressor 201 . 

As for the emt)edded alphabet extension, it is possible to remove the redundancy (mentioned above in the section 
entitied "Embedded Alphabet Extension") caused by the allocatbn of coding space which is known a priori to be use- 
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less. An alternative embodiment of image compressor 201 eliminates this redundancy by first examining the maximum 
. ^; v^3rin r. <4:tTKn 'possiWo length of^th e'njnriwhich»carrtoshoFteptthan. the maximum all ^ T>^A'«horteMenglh=TTTay*be^due*?«*«"»*««»!?->*a^^^ ^ ^ 

to either a broken run of NE pixels or a boundary, both of which can be also detected by the decoder. The encoder 707 
uses a different code for each possit>le value of this maximum length, between 2 and r. The alphabet extension tree for 

5 each code covers only achievable runs, thus renxTving the redundancy. Clearly, the decompressor 1 201 can keep track 
of the code used by the encoder 707 without any side information. A single end-of-run distribution is shared by the r-1 
different codes. Another possible alternative emtxxiiment processes runs of other very frequent contexts, not necessar- 
ily the zero-gradient one (e.g., contexts satisfying that |a-c|, |b<|, and |a-d| are at most 1). 

Another alternative embodiment provides for one-pass coding in applications where two passes cannot t>e 

10 afforded. In such an embodiment, a first approximation consists of designing fixed Huffman tatsles whteh are made 
available also to the decoder. This is possible in applk;attons where homogeneous data with specific characteristics is 
expected, e.g., MRI medical images. A fixed-table version of the present invention maintains adaptivity, because the 
context nxxleling classifies the pixels into classes which are encoded with different tables. Although this is a 0-param- 
eter code, in the sense that no parameters are learned and transmitted to the decoder, the number of contexts still plays 

15 a '^TVxJel cost* role, since it determines the anrK>unt of training data needed to tailor fixed tables. Another alternative is 
the use of Golomb-Rice codes (as described in R.F. Rice, Some practical universal noiseless coding technk^ues. Tech- 
nical Report JPL-79-22, Jet Propulsion Laboratory, Pasadena, CA. Mar. 1979) instead of Huffman codes. Rnally, as - 
complexity permits, the present invention can be adaptivety encoded with an arithmetic code in one-pass, producing 
compression results at least as good as (and likely better than) the two-pass version. 

20 Additionally, the system and method of the present invention, as described afc»ove in conjunction with Rgures 2-12. 
is adaptable to the compression of color images. How the present invention is used in conjunction with color images 
depends on the color space in whk^ the image is represented. The YUV-type of representation is generally assumed 
to produce fairly unoorrelated images. whk;h, consequently, can be independently conpressed as gray-scale images. 
On the other hand, the RGB representation in some cases presents a strong correlation between its components. 

25 Hence, although the image conpression method of the present inventbn may be applied to separate planes, in other 
RGB-alternatives the prediction and modeling templates account for inter-plane correlation. In one embodiment the 
Green plane (which contains nfK>st of the luminance infbrmatk>n) is compressed as a gray-scale image, and then using 
its pixel values to model the other two planes. 

Predictors for the Red and Blue planes, based on both intra-plane correlation and correlation with the Green plane, 

30 used by a compressor for color images according to the present inverrtbn, to be followed by the method of the gray- 
scale version of the image compressor 201 predkis the Blue and Red planes by 



35 



= -o- + ^ /+1 3 



where the siperscript (G) denotes the corresponding value in the Green plane. Thus, a predictor operating according 
to (1 0) can be interpreted as con-ecting the value that wouki t>e picked by the predk:tor number 7 of JPEG, with the error 
made by this predictor in the Green plane. The accumulated savings in the three color planes (24-i)it pixels) with respect 
40 to lossless JPEG are 2.61 bits/jpixel for "girl " and 3.75 bits4>ixel for 'l>aft>ara. " 

Table 4 shows results obtained with RGB representations of two images from the JPEG set by compressing the 
Green plane with an innage compressor 205 using a predictor 207 operating according to (10) fLOCO^I with interplane 
predictor) compared to LOCO^I operating according to (2) ("Plain LCXX)2|") and Lossless JPEG: 



Table 4 



Image 


Plain 
LOCO^I 


LOCO^I with inter- 
plane predictor 


Lossless 
JPEG 


girl R 


4.36 


3.49 


4.69 


G 


4.04 


4.04 


4.34 


B 


4.24 


3.44 


4.55 


barbR 


5.13 


3.66 


5.43 


G 


4.93 


4.93 


5.22 


B 


5.17 


3.77 


5.46 
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defined by the ISO/1EC/SC29/WG1 committee. The near-lossless standard requires that there is a uniform bound e 

(e.g, 1 , 2, 3, 7) on the difference between each original pixel and its decoded version. 
5 Figure 14 is a t)lock diagram showing the configuration of an image compressor/decompressor system having a 

pre-processor 1401 prior to an image compressor 205*. The image compressor 205' is of the same design and operates 

like the image compressor 205. The preprocessor introduces the allowed error. Thus, the mox is transparent to the 

image compressor 205'. which operates in a lossless scheme. 

The pre-processor 1401 is a scalar quantization that maps each pixel value into one of approximately A/(2e + 1) 
10 values, thus reducing the size of the input alphabet A . More specifically, according to one embodiment each pixel value 

in the original image is mapped into 



75 



2e + 1 



(11) 



20 



25 



Subsequent to the mapping of all pixels, Xy, in the image to corresponding values y; the image compressor 205' 
compresses the image / according to the procedure described for image compressor 205 into conpressed image y\ 

The con-esponding decompressor 120 V is of similar design and operates according to the same method as image 
decompressor 1201 , described atx)ve in conjunction with Rgure 1 2. The decorrpressor 1 201 ' losslessly decompresses 
y' into image y according to the procedure described above for image decompressor 1 201 . 

The image decompressor 1201' is followed by a post-processor 1403. The post-processor 1303 is a scalar dequan- 
tizer and performs a reconstruction mapping according to 



30 



= y(2e 



1) + « 



(12) 



TTie at)solute value |x - of the reconstruction error is upper-bounded bf e, because x' is the positive integer clos- 
es est to x and congruent to e mod [2e + 1). With (12) large values of y might be mapped to values greater than A-1, 
in which case X' is truncated to -) . 

In another near-lossless emtxxiiment of the present invention, the pre-processor 1401 maps each pixel value Xj 

into 



40 



26 + ij 



(13) 



45 



In this alternative, the corresponding reconstruction mapping performed by the post-processor 1403 according to 



50 



x'^ = y.(2e + 1) 



(14) 



55 In tftis embodiment, x',- is the positive integer closest to x arxl congruent to 0 mod (2e -i- 1 ). In the event of an "over- 
flow" the post-processor 1403 truncates excessive values to ^-7. 

Figure 15 is a block diagram of a computer system 1501 incorporating the image compressor 205 and image 
decompressor 1201. The corrputer system 1501 has a central processing unit 1503 connected to one or more image 
sources 1505. The image sources 1 505 may include devices such as digital cameras and scanners. The computer sys- 
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tern 1501 may also be connected to computer networks, such as local area networks, the Internet, or online services, 

-i/>?r?i;s:i:.w>v s?t,>v/;viaTietwork*conneclionsit1507^(e:gf;V^^ modem);'TTieCPU^1503transm!ts^infiages-*''« 
from the image sources 1505 to the image compressor 205 which compresses the image according to the method 
desaibed abova 

5 The CPU 1 503 is further connected to storage devices 1 509, e.g., menrtories (both for storage of images and other 
data), disk drives, and tape units. Subsequent to the compression of the images, the CPU 1503 may transmit Images 
to these storage devices 1509. Alternatively, the CPU 1 503 may direct the images to the network connections 1507. 

Hie computer system 1501 may also decorrpress compressed images for display TTie CPU may. for example, 
obtain a compressed image via the network connection 1507. The CPU 1503 directs such compressed images to the 
10 image decompressor 1 201 which decompresses the image according to the method described above for image decom- 
pression The CPU 1503 is further connected to a display 1511, &g.. a cathode-ray tube or flat-panel display The CPU 
1 503 directs decompressed images for display on the display 1511. 

In one embodiment, the image compressor 205 and the image decompressor 1201 is implemented as computer 
instructions operable to direct the opeartions of the CPU 1503. In such a case the image compressor 205 and image 
IS decompressor 1 201 are stored in one of the storage devices 1 509 and are executed by the CPU 1 503 to compress and 
decompress images according to the methods of the present invention. 

In an alternative embodiment the image processor 205 and image decompresor 1201 are special purpose hard- 
ware devices, e.g., image processing accelerators, attached to the CPU 1503 as auxilliary devices. 

In certain applications, a conputer system 1501 may need only be able to decompress images and not to conrv 
20 press images, and vice versa. In such cases either the compressor 205 or decompressor 1201 may k>e absent from the 
computer system 1 501 . 

As a person skilled in the art will realize that numerous nxxjifications and changes may be made to the present 
invention, it is not desired to limit the inventbn to the exact construction and operation as illustrated and descril>ed. 
Hence, all suitable modifications and equivalents may be resorted to as falling witNn the scope of the invention. 

25 
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55 Claims 

1 . A method of operating a computer (1501) to losslessy compress digitized images (105) comprising the steps of: 
a. retrieving an image (105) to compress from an input device (1503, 1509); 
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b. directing said conrputer (1501) to use the context of a pixel (303) in said image (105) to determine a pre- 

.--/.■•r*ti z:--'. \ 1^ dieted = value -for said pixel ■ (303) \^ .?^;A\t *'.iT.-^*:.c.;(r.'.v.v.'.>5. v f < -i ^tri^^-K^-f^ :? » « ■ ir, v:>:>.«;I':,-g? > tv-r' f ' f.-.irr;.: t.'iXiV' . -^t lirrc'./v vs?^ .ir.,- ; s^:;": .v^rTiirr ^-r- ■ ^ / ■>.!. 

c. for each context, txiilding a context specific Huffman table corresponcSng to said context; 

d. comparing the predicted value and the actual value, thereby producing a residual; 

e. retrieving a code corresponding to at least one of said residuals from a context-specific Huffman table; and 

f. transmitting said code to a decoder (1201). 

2. The method of Claim 1 wherein said computer (1501) determines said context-specific Huffman tables by for each 
context determining the distribution of error values and using said distribution for said each context to build said 

10 context-specific Huffman tattle. 

3. The method of Qaim 1 or 2 further comprising the steps of: 

computing said context by detemiining values of gradients between pixels (305. 307, 309.311)adjacenttosaid 
15 pixel (303): and 

computing said context by quantizing said gradients into approximately equiprobable regions; and vt^erein said 
Huffman tables correspond to said quantized contexts. 

4. The method of Claim 1 , 2 or 3 wherein each context-specific Huffman tat>le contains codes corresponding to each 
20 member of an alphabet of encodable events, and wherein for at least one context the alphabet of encodable events 

is extended to include events that are not prediction residuals (1115, 1117,1119, 1121. 1123). 

5. The method of Claim 4 wherein said alphabet extensions encodes a length of consecutive constant prediction 
residuals; and 

25 

for the first pixel following said lengtii of consecutive constant precfiction residuals, retrieving a code for tiie 
residual for said first pixel following said length of consecutive constant prediction residuals from a non-context 
specific Huffman tat)le ttiat does not include said constant precfiction residual. 

30 6. The method cf Claim 3 further comprising the steps of: 

forther subdividing at least one of said quantized contexts into a plurality of suth quantized contexts; arxi 
wherein said step d furtiier comprises: 

35 for each pixel occumng in one of said at least one of said subdivided quantized contexts, determining a 

particular sul>quantized context of said sub<livided quantized context wherein said pixel occurs in said — 
particular subquantized context; and 

retrieving a code corresponding to said residual from a context-specific Huffman table corresponding to 
said particular sutHifuantized context 

40 

7. The m^hod of Claim 1 wherein said context of said pixel (303) comprises a first pixel (305) located north of said 
pixel (303) and having a value a. a second pixel (307) located west of said pixel (303) and having a value b. a third 
pixel (309) located northwest of said pixel (303) and having a value c. and a fourth pixel (31 1) located northeast of 
said pixel (303) and having a value d. and said step b of determining a predicted value x , according to: 

45 

if a+b-c i max(a',6) 
if a-i-b-c ^mn(a\b) 
otherwise 

a^=i (^^^'2 // |a-d|<4|a-c| A sign(a-d)=sign{c'a) 
\ a otherwise 



max(a',A) 
min(a',A) 
a+b-c 



8. The method of Qaim 1 wherein said codes retrieved from said context-specific Huffman tetHes are (30lomt>-Rice 
codes. 
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9. An image compression encoderAdecoder system wherein for each pixel (303) in an image (105) there Is a context 

'.^^T.iy^zyv^T-v-Zfrv-^y^--^ - l>asedon thepb<els(305,307;:309/31d)thatha^ pixel^(303)vhavingan*€ncoderw:i5^-^ii^>^^'«-^^'-^ 
(201) conrprising: 

5 a. an image buffer (203) containing at least one digitized image (1 05); 

b. a pixel and context generator (205) connected to said image buffer (203) and operable to determine the 
value of a pixel in said image buffer (203) and the context of said pixel; 

c. a context quantizer (801) connected to said context and operable to quantize the context of a pixel; 

d. a table memory (71 1) for storing a plurality of context-specific Huffman tables; 

10 e. a predictor (207) connected to said context and operable to predict the value of said pixel based on said con- 

text: 

f. a subtracter (71 1) connected to said pixel and to said predictor (207) and operable to subtract said pixel value 
from a corresponding predicted value, thereby obtaining an error value for said pixel; and 

g. a code generator (209) connected to said pixel and context generator (205) and to said context-specific Huff- 
75 man tables and operable to retrieve a code based on said context, said pixel value, arxi said context-spectfic 

Huffman table corresponding to said cont&ct. wherein said code generator (209) uses said error value to 
retrieve said code from said context-specific Huffman tat)le and wherein said code generator (209) uses said 
quantized context to select a context-specific Huffman tatHe from which to retrieve said code. 

20 10. The image compression encoder (201) of Claim 9 wherein said quantized context determlnator (209, 703) deter- 
mines gradients in said context and determines in which of several regions said gradients fall. 

1 1 . The Image compression encoder/decoder system of Claim 9 or 1 0 further comprising: at least one context-specific 
Huffman tattle having an alphabet of encodable events exterxled to irx^lude events that are not prediction residuals. 

25 

12. The Image compression encoder/decoder system of Claim 9. 10, or 1 1 wherein said alphabet extension is a length 
of consecutive constant prediction residuals. 

13. The Image compression encodeAdecoder system of Claim 9. 10, 11, or 12 wherein said context-quantizer produces 
30 a first Index, further comprising: 

a context sut>-quantizer (803) connected to said context and operable to quantize the context of a pixel at a 
finer resolution than said quantizer and to produce a second index; and 

a multiplexer (805) connected to said context quantizer (801) and to said context sut)-quantizer (803) operable 
35 to select one of said first and secorxJ indexes. 
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